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ABSTRACT 



The work investigates the notion of separability in 
continuous parameter stochastic processes. It explores the 
implications of relaxing the separability hypothesis. 
Various numerical results are obtained for a particular 
example, the 0-1 Markov process. 
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I. INTRODUCTION 



Our aim is to investigate peculiarities of non-separable 
processes. In Chapter II we introduce the general notion of 
separability for abstract, continuous parameter stochastic 
processes following Doob’s presentation [2]. We then 
illustrate the concept in action by studying the 0-1 Markov 
process, to which Chapter III is devoted. We first define 
the class of measurable sets generated by the finite 
dimensional measures. Then, following Halmos’ presentation 
of inner and outer measures and extensions [ 3 ], we extend 
the measure in a non-unique fashion to a larger class of 
sets. Each extension specifies a particular equivalent 
version of our process, the separable case being one of the 
collection. Learning that certain constraints were involved, 
we derive a functional equation later in the chapter, and 
such a functional equation summarizes all the constraints. 

We then place the non-separable case under a new light 
through the use of a ’’factor function" which we relate to 
the probabilities within the non-separable process. From 
this new vantage point we were able to prove that at a 
particular parameter value either all or none of the sample 
paths are continuous. We conclude our work with suggestions 
for further study. 
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II. SEPARABILITY 

In this section we wish to present the concept of 

separability in stochastic processes that have a continuous 

parameter set. As will be seen, such processes deal with 

sets that are not measurable unless certain conditions are 

placed on the process. The concept of separability gives 

the required conditions enabling such sets to be measurable. 

Hopefully, this section will make clear the concept of 

separability, as well as the problem we wish to present. 

Let {x^jteT} be a stochastic process with parameter 

set T which is any interval of the real line. The random 

variables x, are defined on a set fi. Let eA. denote a class 
t 

of closed sets. Then the process is said to be separable 
relative to cA if there exists a sequence of parameter 
values f t j } and a subset A of ft of probability .zero such 
that for Ae cA and any open interval I in T, the w-sets 

{x fc (w)eA,teI} {x^ (w)eA,tjeI) 

differ by at most a subset of A. We will use the term 
"a separable process", acknowledging that it is with respect 
to cA since the context is clear. Also we will call any 
sequence {t n > satisfying the conditions of the separability 
definition, a separability set. 
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Except in pathological cases the separability set { t n } 

is dense in T. If we enlarge our separability set by adding 

a countable number of other parameter values, the new 

sequence {F. } is also a separability set, since {t . }e{F. }«T. 

J 1 J 

Conversely, if any countable dense subset is a separability 
set, we say the process is well - separable . 

It was worth questioning whether we could restrict our- 
selves to open intervals I with rational, or infinite, 
endpoints, and still satisfy the separability definition. 

The question proves to be true. Consider an interval (a,b) 

where a and b are irrational. Let a 4-a and b tb, where 

n n 5 

the a ’ s and b ' s are all rational. We observe that for 
n n 

n>m, and any AecA, 



M n = {x^( w )cA > t J e(a n ,b n )} S M m ={x^( w )eA > t J c(a m ,b m )} 



and show that 



M = {x (w)eA,t ,e(a,b) } = ft M • 

Z i J n=l n 

CO 00 

Certainly M £ /l M . So take an ue f| M . If cofcM, then there 
_ n=l n n=l n _ 

is a t.e(a,b) such that Xr- (w)i;A. But there exists an n 

such that t.e(a— ,b— ), and weM— which gives us a contradiction. 
J n n 5 m n 6 

Thus weM. Hence, M = fl M . Therefore in our definition 

n=l n 

of separability, it is sufficient to restrict the condition 
to open intervals of rational, or infinite, endpoints. 



6 



Looking at the two w-sets in our definition of 
separability, we could express the sets in the form, 

(1) {x. ( w) eA,t el } = 0 {*. (oo)eA} and 

r tel 

(2) (x (w)eA,t,eI) = (\ {x e A} . 

Z i J t j el 

The w-set (2) is the intersection of a countable number of 
measurable sets, hence, the intersection is measurable. 

Though each w-set in the intersection of Equation (1) is 
measurable, this is not enough to show that the intersection 
is measurable, since the intersection is over an uncountable 
number of sets. However, because of the separable condition, 
4>-set (1) has the same probability as w-set (2). This 
subject of countable or uncountable operations seemed to be 
the main problem in the non-separable processes we considered 
once we leave the countable realm, we become very dependent 
on the concept of separability. 

Nov; consider the operations of greatest lower bound, 
gib, and least upper bound, lub, and suppose our process 
is separable. Choose an w not in the null set A. Then for 
a separability set {t^} > and any open interval I, we can 
find an a such that 



a = gib x. (w ) , 

V 1 J 



-<® < a. 



If b = gib x (w ) , we wish to show that a = b using the 
t el r 
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separability definition. Certainly b £ a. Assume b < a, 
then consider the co-sets, 

(x, ((o)e[a,°°] ,tel) and (x, (co)e[a, 0 °] ,t . el} . 

t t. j 

By the definition of separability, the two co-sets differ 

only by a subset of A, and since co is not in the first 

co-set, but is an element of the second, to must be in A, 

which is a contradiction. Therefore, a = b, or, more 

specifically, gib x (co) = gib x, (co) for all to^A. In 
tel r tjel j 

a similar fashion we could show that lub x, (co) = lub x (co) 

' tel r t . el 

J 

for all co ^ A. In particular, if co ^ A and if t e I, then 

gib x, (co) = gib x (co) <_ Xtt(co) , and 
t .el tel * ^ 

J 

Xr-(co) £ lub x (co) = lub- x (co). Thus, 
r tel r t.el 

J 

(3) lim gib , x (to) £ x^(co) < lim lub _ x, (co), 

n *°° t J n *°° l t j" t l < n 

co $ A . 

A classical theorem concerning separability utilizes (3), 
stating that if a process is separable, and a sequence { t . > 

J 

satisfies (3) for every F e T, then the sequence is a 
separability set. If we place the further condition that 
if for every F e T we have 
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(convergence in probability). 



(4) p lim x, = XT- 



then any countable dense subset of T is a separability set. 
This is true, for if we take any countable dense subset of 
T, it satisfies condition (4) by hypothesis. Thus, this 
subset satisfies (3)- Therefore the process is well- 



separable. 

Showing that gib x, (to) = gib x,(to) and 

t . el j tel 

J 

lub x (to) = lub x, (to) for all I open, to £ A, in the 

t .el 3 tel r 

J 

separable process, we obtain another natural result: For 

w £ A 



(5) lim inf x, (to) = lim gib _ x (to) 

tj-*-t z 3 n-x" |tj-t|<l z 3 



- lim gib _ x (w) = lim inf x (to) 
n-*» 1 1 . — t | <1_ t+t 

^ n 



and 



(6) lim sup x. (to) = lim lub _ x (w) 

tj-^t j n^o |tj-t|<l 



= lim lub_ x (w) = lim sup x, (to). 

n-K» 1 1 — 1 1 < 1_ t-»-t 

n 



.Thus, in the separable process, lim inf x + .(to) and 

t->-t 

lim sup x. (to) are random variables. With this result, the 
t+t 
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( 



probability of events concerning limits, strong continuity, 
etc., may be expressed in terms of probabilities of lim inf's 
and lim sup's, and, hence, is determinable. 

Now there is the question of whether or not any stochastic 
process can be made separable, without changing the character 
of the process to any appreciable degree. In other words 
we are speaking of equivalent processes; a process {x t ,teT} 
is equivalent to the process {x t ,teT} if and only if 
P{x fc (w) = x (co)} = 1, for each teT. So restating the 
question, for each stochastic process (x t (w), teT} does 
there exist an equivalent process Cx t (w),teT} such that the 
x-process is separable? We will show that the statement 
is true. 

As is necessary in the definition of separability, we 
must find a separability set and a null set A. Our 
separability set will be formed by construction, and then 
from this separability set we will describe parts of our 
null set. 

First, we show that for each closed set A, we can find 
a sequence t^ , ... such that 

(7) P{x^_ ( w) eA,n>l ; x fc (w) $:A} = 0 for each teT. 

n 

So take a closed set A. Now choose any finite sequence 
t-^, ..., t^. of parameter values. Define 
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and 



Gj t = {x t (co)eA,n<J jx^CoOifA} , 






= lub P(G. . ) 



teT 






We note that for a fixed t, the G. *s form a decreasing 
sequence of sets, implying that >_ • • • If p^ = 0, 

then we have found the desired sequence for the particular 
closed set. If p^ > 0, by the definition of lub, there 
exists a t such that P(G^ >_ p^Cl - , and we let 

t k+ -^ = x. Then, by induction, we form an infinite sequence 
t^, t£, Assume that > 0, for all k. For each t, 

we have 



(8) P{x. (w)eA,n>l;x. (co)^A) <_ lim p. . 

n k-*» 

Consider the w-sets, 

H = ’{x, (w)eA,n<k;x, £A} . 

K z n k+1 

Since the H^'s are disjoint, the probability of their union 
equals the sum of their probabilities, implying that 
lim P(H. ) = 0. But by definition, P(H, ) > p, ( 1 - ip) ; 

^ K K K 

thus, lim p, = 0. From (8), 

k->oo 

P{x t (u)eA,n>_l;x t (u)^A} = 0 , for each teT, 
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and so we have found the desired sequence for a particular 
closed set A. 

Now let cA q be the class of sets which are finite unions 
of closed intervals with rational or infinite endpoints. 

If cA is the class of sets which are intersections of se- 
quences of sets in cA q , then includes all the closed 
sets. By the preceding paragraph, for each A e cA q there 
corresponds a particular parameter sequence such that (7) 
is true. Since there is a countable number of closed sets 
in cA q , we let {t^} be the union of all the corresponding 
sequences. Let 



A t (A) = {x^ (<o)eA,n>l;x t (w)$A} , 



and 



A 



t 



U A. (A) . 
AecA 0 



We note that P(A t ) = 0, since there are only a countable 

number of A^(A) f s to consider, each of which has probability 

0. Now if A e cA , and A e cA such that A «* A , then 

* o o o’ 



(9) {x fc (w)eA,n>l;x. t (u))$A} <= {x (w) eA Q ,n>l ; x t (w) ^Aj « A t . 

n n 

The implication then follows, since each c4-set is an 
intersection of cA^-sets. 

Now let I be an open interval with rational or infinite 
endpoints, with I ^ T, and then restrict our process to the 
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process {x^jtel}. For this restriction, we let 

(t } T = (t } H I. Then by our previous results, there 
n I n 

exists an co-set such that 

P(A T ) = 0 for each tel, and 
r , ± 

{x_ (co)eA,se{t } x ;x, (to) iA) A. T , for each A e c A . 
s n x u u y -L 

Let 



S = U (t } T , A = U A. T where I is 

lei n 1 t lei r 

r r 

the class of all open intervals in T with rational or infinite 

endpoints, implying I r is countable class of open intervals. 

For a fixed w, we define A(I,w) to be the closure of the 

set of values of x (co) where s varies in I fl S. The values 

s 

of ±oo may be in A(I,to). This set is closed and non-empty, 
and we note that 

x t (u))eA(I,io) if teI,w£A£. 

Defining A(t,co) = A A(I,co), we know that A(t,io) is closed, 

let 

and since we have made the class of A(I,o))’s compact by 
including the values ±°°, A(t,w) is non-empty. So 

x^(u)eA(t ,w) if teT,co^;A t . 
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Thus, we define our x-process by. 




J x t (w) 



if t e S 



x t (co) if t $ S w £ A t 
k any value in A(t,oj) if t $ S, u e A t . 



We now want to show that the x-process is separable, and 
equivalent to the original x-process. Certainly 
P{x t (co) = x t (aj)} = 1, implying that the two processes are 



oj is such that x (to) e A for all s e I fl S. Hence, by 

o 

definition A(I,gj) <= A. So if t e I, then by our construction 
of x. 



x^Coj) = x^Cto) e J A(I,co) c A if t e S, or t$S,co$A t 

|^A(t,oj) <= A(I,o)) 0 A if t^S,u)eA.£. 



(10) {x s (o))eA,seiriS} = (x^ (co)eA,teI} . 

By a previous argument, we know that we can restrict the 
definition of separability to open intervals with rational 
or infinite endpoints. Therefore our x-process is separable, 
and thus, every stocahstic process has an equivalent, 
separable process. 



equivalent. Now let A e cA , and suppose that I e I and 



Thus , 
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It is important to note some characteristics of this 
constructed separable process before leaving this section. 
Though it may be too strong to say that the null set A of 
this process is the void set, it is, nonetheless, true that 
for all open intervals I in T and A in cA , the two co-sets 

{x (<o) eA, selAS } and {x, (co)eA,teI} 

S u 

differ by a void set. The construction has eliminated from 
the x-process all sample paths, characterized by an to, 
which behave, in some sense, badly. There are possibly an 
uncountable number of separable processes equivalent to the 
x-process, but this x-process is the best one can hope to 
have, in the sense that every sample path behaves well. 
Thus, this x-process represents one extreme of the class 
of all processes equivalent to the x-process. It is fair 
then to ask what process represents the other extreme. 
Because of the abstractness of our sample paths, we delay 
this question until a later section, where we consider a 
particular process in which the sample paths are easier to 
picture . 
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III. THE 0-1 MARKOV PROCESS 



In considering the separability concept, the continuous 

parameter process we will study is the 0-1 Markov process 

{x. (w) ,te[0,t ]}, where t < <». In such a process, whether 
z o o 

separable or not, certain finite dimensional probability 
properties are true. Define p..(s,t) to be the transition 
probability; that is. 



p.,(s,t) = P{x, (to) = j | x (cj) = i}, where 0<s<t<t , 

JLJ US o 

i,Je(0,l}, 

and P{x (m)=i}>0. 

S 

For our process, the transition probabilities have the 
stationary property that p..(s,t) depends only on the 
difference t - s, and we may write the transition probability 
as p^.(t-s). Further, these transition functions can be 
derived and are of the form: 

P 0 Q (t) = a + be -t 
Pn(t) = b + ae~^ 

where a,b > 0, and a + b = 1. 



P 0 i(t) = b - be -t 
P 1 Q (t) = a - ae _t 
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A. THE SEPARABLE 0-1 MARKOV PROCESS 



Now let us suppose that our process is separable. It 
can be shown that 



A A 

P{x t (co)=i,t<t<t+a| x£(to) = i} = e~ q i a 



where q. 

1 



b if i = 0 

a if i = 1 . 



We know also that each sample path in which there exists 
an instantaneous jump from one state to another has 
probability 0. In particular, sample paths of the form. 



{x t (w)=0,te[0,t] ;x t (w)=l,te(t ,t Q ] , | x o (w)=0} 

have probability 0. However if we take the probability of 

the collection of all such sample paths (that is, the 

probability of exactly one transition in the interval 

[0,t ]), we obtain r— ! — (e“ at o - e" bt o). If b = a = i, 
o b-a d. 

the probability is derived by taking the limit as b and a 

both approach %, and the probability is %t Q e ' 2 o. These 

probabilities are conditioned on the event that x Q (to) = 0. 

If we condition them on the event that x (to) = 1, the 

o 

probability of exactly one transition in the same interval 
is — a k (e~ bb o - e _at o), and again if a = b = %, we get 

-I't 

^t Q e 2 o . As will be seen later in this section, these 

17 ' 



probabilities are bounds for the arbitrary probabilities 
that may result from the same events in the non-separable 
processes. Other "separable" probabilities for different 
events could also be calculated, but those mentioned above 
will suffice for our discussion of the non-separable process 

B. THE NON-SEPARABLE 0-1 MARKOV PROCESS 
1. Extension of the Measure 

The finite dimensional probabilities yield a 
measure for events involving a countable number of parameter 
values. The collection of all these events will be the 
o-algebra S, with the probability measure y. We now wish 
to prove and apply the following extension theorem: 

Theorem: If M e S, there exists a (non-unique) 

probability measure y, an extension of y, defined on the 
o-algebra S generated by the sets in S and the set M. 

Proof: We first show that cA = { (EftM)U(FflM ' ) *. E ,FeS> 

is the o-algebra S that we are looking for in the theorem. 
Since X,<J> e S, we have that M = (X()M)U (MM ' ) ecA . Also, 
for all EeS , it follows that E = (EnM)U(EfiM' )ecA , implying 
that S «= cA . Thus, cA is in a sense generated by the sets 
in S and the set M. Now we must show that cA is a a -algebra 
Let A^, Ag, ... e cA , implying there exist 
Ei, Eg, ..., F^, Fg, ... e S, such that 

A 1 = (E 1 AM)U(F AM' ) , Ag = (EgOM)U (FgAM' ) , ... Since 
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oo oo 

Ij E eS and l| F eS, we have that 
n=l n n=l n 

U A = [( U E )AM]U[( U F )flM’] e cA. Also if 
n=l n=l n=l 

A = ( EflM ) U (FAM* )e cA , then 

A' = [ (EflM)U(FAM' ) ] ' = (E'UM 1 )fl (F *1) M) = (E’f) F' )U (E'A M)U (F'A M' ) 

= (E’A M)U (F’A M)e cA • Therefore, cA is a a-algebra. 

Let m % and m* denote the inner and outer measure, 

respectively, with respect to measure y. If m#(M) = a > 0, 

then there exists for each n a G e S such that G «= M 

n n 

1 00 

and a - — < y(G ) < a. Let G = 1) G . Certainly G =■ M, 

n=l 

and G e S. Further, by the definition of inner measure, 
m*(M - G) = 0. Now if m*(M) = b > 0, in a similar fashion 

. OO 

we can find a sequence of H 's in S such that if H = A H , 

n=l n 

then M «= H, and m^CH - M) = 0. Thus, we have found 

G,H e S such that G M c H and y(G) = m#(M) and m*(M) = y(H). 

Now let D = H fl G', and let A = (EAM)U (FAM' ) e cA . 

Then AAD’ = (EAMAD 1 )U(FAM'nD’ ) = (EnG)U(FnH' ) e S. Thus, 
for all A ecA , A [\ D* e S. We may rewrite m s (M-G) = m*(DAM) 
and m # (H-M) = m^CDAM’). So 

m* (DflM) = m* (DAM) + m#(DAM’ ) = y(D) = m*(DAM’) + m*(DAM) 

= m* (DAM' ) . 

Let A x = (E 1 AM)U(F i nM’ ) and A 2 = (E 2 AM)U (F^M 1 ) , with 
A^, A 2 ecA . Suppose A^HD = A 2 AD. Then it must follow that 
(E-jAmAD) = (E 2 AmHD) and (F^M'flD) = (F^M'AD). If (E^D) 
and (E 2 0D) disagree, then their symmetric difference. 
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(E-jOD) A(E 2 f\D) , is a subset of M ' . Thus, 

(E i nD)A(E 2 nD)cDnM' . Hence, y ( (E^D) A (E^D) ) <m* (M 'fl D) = 0. 
Therefore, y(E^flD) = y(E 2 f|D). In the same fashion we can 
show that y(F^fiD) = y(F 2 AD). 

Now we define our extended measure y on the a-algebra 
cA . Let a, 6 >. 0, with a + g = 1. Then for 
A = (Ef\M)U (FfiM’ ) e cA , y is defined by, 

y( (EflM) U(FAM' ) ) = y ( [ (EftM)U (FflM 1 ) ]flD' ) + ay(EflD) 

+ gy(FHD). 

By the preceding paragraph, such a measure is well-defined, 
and certainly for all A e <A , y(A) >_ 0. If A = <J>, then 

y( 4 >) = y(C(4>AM)U(4>riM T )]nD f ) + cty(<t>/p) + gy(<t>f|D) 

= y(4>) + ay(<f>) + 0y ( 4> ) = 0. 

Now let (A n ) be a dis joint sequence in cA , where 

A = (E AM) .(F DM' ) . Then, 
n n n * 
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oo 



oo 



y( U A ) = y(( u E M)U ( U P M')) 

n=l n n=l n n=l n 

= y(C ( U E flM)U( U F H M ' ) ] (1 D 1 ) + ay( U E (|D) 
n=l n n=l n n=l n 

OO 

+ 3y( U f Ad) 

n=l n 



OO oo 

= y( U [(E^MAD* )U(F n nM'AD' )]) + Z ay(E HD) 
n=l n=l 

oo 

+ E MF AD) 
n=l n 

OO oo 

= Z (y[ ( (E flM)U (F AM* ) )HD' ] ) + l ay ( E fl D ) 
n=l n n n=l n 

OO 

+ Z 3 y ( F fl D ) 
n=l n 



= Z (y[( (E flM)U(F AM' ) )nD* ] + ay(E AD) 
n=l n n n 

+ 3y(F n nD)) 



- Z y ( A„ ) . 



n=l 



n 



Thus, y is a measure on (A . Further, since 
(EHM)U (ERM* ) = E e S, 

y(E) = y (EflD’ ) + (a+3)(y(EHD) = y(EAD') + y (EQD) = y(E) . 
Hence, y = y on S. Also, since 

y(M) = y(MAD') + ay(D) = y(G) + ayCHHG') = y*(M) + ay(HflG')- 
If a = 1, then y(M) = y(G) + y(Hf\G') = y(H) = y*(M). 
Therefore, y*(M) £ y(M) £ y*(M), depending on a (and 3). 
Setting S = cA, we have proved the theorem. 
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Now suppose we have a countable sequence of sets, 

M. , M„, not In S. Let S (M , , ) be the extended 

12 n n+1 

c-algebra, S n+ ^, generated by the sets in the c -algebra 
and the set M n+ -]_* It follows that, 

S c S 1 = S(M 1 ) & S 2 = S 1 (M 2 ) c ... 

00 

Let = l)S. If A and B are in ^ , then there 
t n 3 

n=l 

exist a j and k such that A e S. and B e S. . Without loss 

0 k 

of generality, we can assume j ^ k. Then B e S. . Thus, 

AUBeSj«=' : f. Certainly if C e , then C e S^ for some £, 

implying that C’ e S^ c ^ . Therefore , is an algebra. 

The measure we apply to ^ is y defined by 

s 

y g (A) = y^(A) where A e S^, and y^. is the measure 

on S. . 
k 

We now apply the Caratheodory Extension Theorem: 

Theorem: Let y be a measure on an algebra and 

y* the outer measure induced by y. Then the restriction 
y of y* to the y*-measurable sets is an extension of y to a 
a-algebra containing d. If y is finite, so is y. If y 
is o-finite, then y is the only measure on the smallest 
a-algebra containing d which is an extension of y. 



22 



We relate this extension by considering the M-sets 
associated with intervals in [0,t o ]. For any open interval, 
(r,s) where r and s are rational, we define. 



M 



l,(r,s) 5 {x t ( “ )=1 ° n (r ’ s)) 



and 



E (M., , vlr and s are rational) . 

Defining^ similarly, we let ^ 1)77^. 

Let S be the cr-algebra of all sets which are 
measurable by our finite dimensional probabilities. Since 
the class 7?^ is countable, by the two extension theorems 
above there is a a-algebra jJ containing^ and S. Thus, the 
^-sets are now measurable. Also this extension j</ has pro- 
duced additional M-sets, namely those associated with open 
intervals with irrational endpoints, so these are also 
measurable. Such an M-set is generated by the 'intersection 
of a countable number 7^-sets . It is crucial to realize 
that if r -I- r and s t s, then 

n co n 

llm M 1 (r s ) = A M i f r s ) = M 1 (r s)* Als0 > 
n+°° i,(.r n ,s n ; n=1 i,(.r n ,s n ; 1 »\ r » s; 



P ^l,(r,s) “ M l,[r,s]^ 



P( C{x r (u) = 0}flM 1 ^ r ^ s) A<x s (co) = l}]U [ {x r> (to) = l}f\M 1 ^ ( r ^ s ) 



f\{x s (w)=0}]U [{x r (u)=x s (to) = 0}f\M 1 s ^]) 

0, by properties of the Markov process. 
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Hence, P(NL , \) = P(M_ r -,). Similarly, the same result 

is obtained for any M -set. 

o 

Let m be the measure defined on S, and m x and m* be 
the inner and outer measure, respectively, with respect to 
the sets in S. For any open interval I, m*(M z z ) = 0, 
since the only set in S contained in z is the void set. 

It is to be noted also that in the separable case, 

P(M-, j) = m*(M-^ j). However in the non-separable case, by 
the first extension theorem, the most we have for the 
probability of j is. 



0 = m*(M 1 T ) < P(M 1 z ) < m*(M 1 j) = PO^ j) 



where P denotes the probability in the separable case. 

/N 

Suppose P(M Z ( r s )) = 9P(M Z ^ s ^). It is easily 
shown that P(M 1 s j|x r (u) = 1) = 6 P(M ;l ^ s )|x r (to) = 1). 
Therefore, hereafter when we evaluate the probability of 
an M-set, we are evaluating the conditional probability of 
the set, conditioned on the initial value. Thus, 



-q, I i I 

P(M. T ) = e 1 
- 1 » - 1 - 



where 



fb if i = 0 

li \a if i = 1. 



Also, henceforth,'"/^ will be the class of all z regardless 
of the type of interval I. 

2 . Inclusion of the 1-Transition Sets 

From the preceding section, we have shown that all 
sample paths which are constant (0 or 1) on an open interval 



2k 



are measurable in j/, with the measure being somewhat arbitrary. 
(We will see in later sections that there are other restric- 
tions on the measure.) In this section we wish to show that 
all sample paths making one transition between parameter 
values 0 and t can be described by these /^-sets, hence, 
are also measurable. 

We use the following notation: 



,n 



kt 



v E (x*. (to) = 0 on [0 , — } 



o ,k 



,n 



2 

(k+1 )t 



M l,k+1 s {x t (u) = 1 on ( , ' n - ° -- t o ]> 



,.k,2 n _ ,„2 n n 2 n 
M 1 " M 0,k ^ M l,k+1 



2 n 2 -2 k 2 n 

M, = U 

1 k=l 1 



2 n 

We now show that the lim exists. It is sufficient 





n-*-°° 




■p n 


2 n 


2 n 


to show that lim IVL £ 


lim M . Let 


to e lim M.. . Then 


n-><» 1 


n ->-oo 1 


n-^<» 1 



2 — — 

w e M for some n. Further, there exists an n* > n such 

2 n * k 2 n k* 2 n ' 

that to e . Thus, oo e and w e * for some 

k and k’, with the added condition that 



kt k't (k'+l)t (k+l)t 

O n n n 
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Then we can find a k such that 



o 

p> 

'X 

\ 

o 

-p 

X 

\ 

o 

\x 


(k'+l)t 

o , 


(k+l)t (k+l)t 

° < ° 


2 n 2 n+1 2 n ' 


N 1 S 

2 n ' 


2 n+l 2 n 


, ? n+l ? n+l 




2 n 


Thus, oj e <= 


Hence, by 


induction, to e 



— 2 

for all n >_ n. So w e lim NL , implying that 

n+°° 

2 n 2 n 2 n 

lim £ lim M. . Therefore lim M!r exists. 

n-^oo n-^°° n*>°° 

A A 

Let A = {x^.(o))=0 on [0 ,t ) , x^. (w)=l on (t,t ], for some 

We note that A is the collection of all sample paths which 

makes only one transition to 1 in the interval [0,t ]. 

v, o 

2 n 

W T e now want to show that lim M. = A. 

For to e A and t(w), we can find a positive integer 
N such that for each n > N, there is a k^ satisfying 



k t /s (k +l)t 

_n_o < t < — Q o 



,n 






2 1 1 2 ^ A 

Thus, w e M, for all n > N. Hence, w e lim I^L , implying 

n-*» 

2 n 

that A - lim IYL . 

n->-co 



2 

For to e lim M.. , there is a positive integer N such 

n -x» 

that for each n > N, there is at least one k n such that 
k ,2 n 

to e M^ n . In particular we can find a sequence of^-sets. 
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Ct > 



k ,2 n k .. , 2 n+1 k ,2 n+2 k 1t 2 ; 

Mi” = H 1 n+1 = M 1 n+2 = ... with w c 



for all j > N. It must follow that 



k t k ,,t k , 0 t (k +l)t 

n o ^ n+1 o „ n+2 o ^ ^ n o ^ 

< — — < r^r— < . . . < and 



2 n — 2 n+l — 2 n+2 — 



,n 



(k +l)t (k xl +l)t (k . 0 +l)t 
n o > n+1 o > n+2 o > 



,n 



,n+l 



,n+2 



. > 



k t 
n o 



2 n 



Let 



lim 

n -Ko 



k t 
n o _ 

2 n 



r 



(k +l)t 

and lim — = s. 

n -K° 2 



Certainly r <_ s. If r < s, we can find an n and k— such 
that 



k-t (k-fl)t 
r < -2-2. < - — ■ ° < 5 



,n 






k-,2 
n s 



n 



which gives a contradiction since w e . Thus r = 



s . 



2 n 

Therefore w e A, implying that lim £ A. Hence 

n-*°° 

2 n 

lim M!t = A. 
n-*°° 



From this proof we know that the collection of 
1-transition sample paths in the interval [0,t o ], with 
x q (w) = 0, can be expressed in terms of our7?{-sets. We 
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can use the same procedure with the 1-transition sample 



paths beginning with x o (w) = 1. 

It must be noted that it was just for convenience 

that we used those ^-sets related to the open intervals 

with dyadic rational endpoints. We could have just as well 

chosen any other sequence ofT^-sets whose respective open 

interval endpoints become dense in [0,t Q ]. Then in the same 

fashion, express A in terms of this new sequence. Further, 
s 

if {M^ n } denotes the new sequence. 



s ? n 

lim M n = A = lim PT , 
^ n-^°° ^ 



implying that the measure that is obtained by using {M n } 

2 n 

is equal to the measure obtained by using (M^ }. We also 
have that 0 = m#(A) £ P(A) £ P(A) = (e _a ^o - e ^^o), 

since each of the 771-sets that express A is bounded below 
by 0, and above by its separable probability. 

For k > 1, the k-transition case can be handled 
similarly. We will show the basic construction for the 
2-transition case. We use the following notation: 



0 n 


jt 


n = 

0,j " 


{x t (w) = 0 on [0,-^-)} 


? n 


(j+l)t kt 


Pr 

l,j,k 


= l *t (u)_1 on ( 2 n • 2 n 


0 n 


(k+1 ) t 


* 

o 

111 


{x t (m) = 0 on ( — ,t Q ]} 
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M 



j,k,2 n 

2 



,2 

0, 



.n 



n m: 



l,j,k 



n m 



2 n 
k, 0 




2 n -H 

u 

0=1 



2-2 i k ? n 

( II ) 

k= j+2 d 



A = {x t ( w )=0 on [0,t ) ;x t ( w )=l on (t,t); 

— A 

x. (o))=0 on (t,t ] for some t,t} 

X/ o 

n 

As before, we show that lim Mg exists and equals A, which 
is the collection of all sample paths that make two transi- 
tions in the interval [0,t Q ]. Though we leave out the 
proof, such a limit does exist and in fact equals A. All 
finite-transition sample paths can be expressed in a similar 
manner, and, hence, are measurable with respect to the 
measure of the Tty-sets that express them. 

3 . Arbitrary Assignment of Measures 

We have now reached the heart of our work. In 
working in the non-separable process, the probability of 
an event may be any value between the inner and outer 
measure with respect to the sets in S, which is the c-algebra 
before we extended to include the ^-sets . However, in 
assigning an arbitrary measure to a set, we have (implicitly) 
affected measures of other related sets. As an example, 
consider the set. 



M l,(r,s) = on (r ’ s)) 
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✓s. 

Let P(M) denote the separable probability of the set M. 
Again we are reminded that all probabilities of M-sets, 
hereafter, are the conditional probabilities. Now suppose 
that in a particular process we had that. 



P (M 



l,(r,s) } " aP(M l(r,s) } 



where 0 < a < 1. 



Take an interval which contains (r,s), say the open interval 

(c,d). Then we know that M, , , s s jyi , . 

* 1 , (c ,d) l(r,s), and 



P(M. 



l.<e.d>> - p «l.(c.r)> P(B l,(r,s)> p «l.(.,d>> 



- 6P(M l,(c,r)> 



< aP(M 1 (c ,d) )j since $,y e [0,1]. 



Thus, the probability of all subsets of M. , s have been 

± y \ T yS ) 

affected, since in this example a < 1. Now consider a 
subinterval of (r,s), say (e,f). We have that 

M l,(r,s) £ M l,(e,f>’ and that 



P(M 



l.tr.s) 5 * P < M l,(r,e>> P < M l ; (e,f)> P(M l,(f,s)> 



= 



a l 6 l T l P(M l,(r > s) ) 
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where a^, 0 1 , y^ e [0,1] and a^0^y^ = a < !• Since a^, 0^, 
and y^ cannot all be equal to 1, at least one of the supersets 

M l,(r,e)> M l,(e,f)’ M l,(f,s) Gaining M lj(r _ s) has a 
probability less than its separable probability, and its 

corresponding factor, a , 0^, or y^, must be greater than 

/ 

or equal to a. Thus, assigning an arbitrary measure to a 
set may or may not affect the probability of a superset, 
but at least one superset must have a probability less than 
its separable probability. 

Since we extended our q-algebra S to include the 
Tty-sets, our first concern in assigning probabilities should 
be with these sets. Then all other sets generated by these 
Tty- sets will automatically be assigned a probability. So 
we restrict our work to the Tty-sets hoping to discover some 
criteria for assigning probabilities in our non-separable 
process . 

Prom the preceding paragraph we already have two 
conditions: , 



1) Altering the probability of a set affects the 
probability of all subsets. 

2) Altering the probability of a set affects the 
probability of at least one superset. 

We have another criterion which is obtained from 

the manner in which we extended our a-algebra S. Suppose 

r 4- r and s + s . Then 
n n 



(11) ^ M l.(r n> s n ) ’ V(r,s)> 
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which can be easily shown. If r 4- r and s f s it is 

n n 

false that the lim M n , „ n = M n r „t We reason this 

1 , (r ,s ) l.Lr.sJ 
n^-oo J n * n * J 

00 

in the following manner: Since lim NL , ,. = U M , x 

n-*-°° ’^ r n ,S n J n=l * ^ r n ,S n^ 

oo 

to say that U M , s ) = M 1 (r s) we mean that for an y 

w e Mi f r si> we have that u e H. / g x for some n. If 

>L , J J ^n ,S n' 

we choose to s M 0 , [0 ,r) nM l , [r ,s ] nM 0 , ( s ,t 0 3 > then certainly 

03 e M, r -| but 03 i ( r s ) for all n. Thus, 
j L s J * ^ n * n ' 

lim M, / g s f r s -j. However, from (11) we have that, 

-Vnn 5 ^ vn 5 v\ 5 *- J 1 "- 1 



n+oo 



n n 



3) If r + r and s is, then 



n 



n 



lim P(M, , v ) = P(M , v). We term this third 

1 , l T jS ) 1 , l T * S J 

n-*» 5 n J n 5 } 

condition our "continuity condition". 

Let us consider an example of an assignment of 
probabilities in a non-separable process, where the assign- 
ment is consistent with the three criteria we have established. 
In a particular non-separable process we will make the 
assignment of probabilities to our 7^-sets in the following 
manner: 



ft V(r,s)> ' "S 



P(M l,(r,s) ) if ( r > s )^°> t c / 2) 

2 -2(s-r)/t Q p(M lj(rjS) ) if (r ,s)c(~,t Q ) 

A 

2 l-( 2 s/t 0 ) p(M , v) otherwise. 

-Lj V 3° jSJ' 
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To those T^-sets in which the value is 0 throughout the 
interval, we use the same assignment of probabilities. It 
is easily verified that such an assignment is consistent 
with the three criteria. However, let us examine the process 
more closely. We introduce the functions a, B, and y 
defined by. 



a( (r, s) ) = P(M 1>(r>B) ) 

3 ( (r , s ) ) = -log(a( (r,s) ) ) 
y(s) = 3( (0 ,s) ) . 



We observe that 3((r,s)) = y(s) - y(r), and because of 
the assignment of probabilities, our y function is more 
precisely defined by. 



y (s) 



t 

as if s <_ •— 

t t 

2(s~)log(2) + as if s > -£■ 



^ - n f s ■ tO 

since P(M, , s ) ~ e , where a is the value obtained 

J- , v r , s ) 

at the beginning of this chapter. The graph of the function 
looks like : 
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Y(b) 



Log(2)+at Q 





> 



V 2 



t 



o 



b 



Though this approach worked nicely for this example, the 
approach will fail when a particular assignment gives 
probability 0 to someT^-set, say in which case 3(1) 

has value °°, and, hence, y is not finite. With y not 
finite, consistency tests must be handled more delicately. 



and we shall do so by looking at our assignments from a 
different vantage point. Noting that there is a relation- 
ship between the probabilities of a set and the probabilities 
of its subsets and supersets, we may think of the ratio of 
the separable probability over the non-separable probability 
of an 7^-set as a function of the endpoints of the^-set's 
interval. This ratio is what we will call the factor 
function F(*,«), and write the probability of an ^-set 
in the following form: 



It is now our interest to look for finer conditions. 




Now we wish to characterize the function F. One 



obvious condition that F must satisfy is. 
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1) 0 < F(r,s) £ 1. 



We obtain another condition by examining the relationship. 



P(r - s)P(M l,(r,s)> " ' P < M l,(r, t ) )P(M l,(t,s)> 

‘ P(r > t)P( V(r,t)> p < t - s > p < M l,(t,s) ) 

- P(r,t)P(t,s)P(M 1;(r;S) ) 



where r < t < s. Thus, we have a second condition: 



2’) F(r,s) = F(r,t)F(t,s) for all r < t < s. 



Since the interval (r,r) is actually the void set, we know 
that P(M, , \ ) = P(ft) = 1. So F(r,r) = 1 for all r, and 

«*• y \ ± y * ) 

we may write condition (2*) as 

2) F(r,s) = F(r,t)F(t,s) for all r <_ t <_ s. 

A third condition is derived from criterion (3) stated 
earlier; we have 

3*) If r 4- r and s is, then lim F(r ,s ) = F(r,s). 

n-H» 
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An equivalent statement of (3’) Is 



3) F(r,s) is right continuous in r, and left 
continuous in s. 

The factor function of the example presented earlier can 
be shown to satisfy these three conditions. 

From conditions (1) and (2), we note that F is 
non-increasing for increasing s or for decreasing r. A 
subsequent result is that F is an upper-semicontinuous 
function, which we will show. Choose c > 0, and consider 
the set { (r,s) |F(r,s)<c} = W. If (r,s) e W, there exists 
6 > 0 such that F(r+6,s-6) < c, by criterion (3)* Since 
F is non-increasing for increasing s or for decreasing r, 
the northwest region of our domain with respect to the 
point (r+<$,s-6) is contained in W. In particular there 
is an open area in this northwest region containing Cr,!"). 
Thus, W is open. .Therefore, F is an upper-semicontinuous 
function. 

Now let ^ = {F|F satisfies conditions (1), (2), 
and (3)). Let F^ be a decreasing sequence in ^ . Since 
each F^ is bounded, the sequence converges to some F. We 
wish to show that F is also in ^ . Since the sequence is 
in y , for each n, 

F (r,s) = F (r,t) F (t,s) for all r < t < s. 
n * n * n * — — 
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we know also that 11m F (r,s) = F(r,s) and that 

n-*°° n 

lim (F (r,t) F (t,s)) = F(r,t) F(t,s). 
n+°° 

Thus, F(r,s) = F(r,t) F(t,s) for all r <_ t <_ s , so 
condition (2) Is satisfied. For condition (3) a let r^ I r. 
Then for all n. 



lim F (r. ,s) = F (r,s). 

k^oo n k n 



Choose e > 0. For some n, |F— (r,s) - F(r,s) | < ^ . Now 



there exists a k such that for all k > k 5 



IF— (r. ,s) - F— (r.s)l < e. We note that 
•' n k n * 1 j 



F— ( r k ,s ) — F ^ r k jS ^ — p ( r > s ) for k > k. 



Thus, |F(r k ,s) - F(r,s)| <_ | F— C r* k , s ) - F(r,s)| 

- l P n^ r k ,s ^ ” F ^( r J s ) I + |F-(r,s) “ F(r,s)| 

< |- + |- = e, for all k > k"(n(e)) = k(e). 

Therefore, lim F(r, ,s) = F(r,s), likewise for s, and 
' k->°° K 

condition (3) is satisfied. Obviously,, condition (1) is 
satisfied, giving us the desired result that F e ^ . A 
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stronger conjecture is that each function in 7 ^ is the 

limit of a decreasing sequence of continuous functions 

in ^ . It remains to be proved. 

We may picture the domain of the functions in ^ 

by considering r-s coordinate system, where r and s range 

from 0 to t . Since s is never less than r, the domain 
o 

of each F is the triangular region bounded by the lines 

r = 0, s = t , and r = s. Vie illustrate: 

3 o 



s 




By the argument used earlier, F(r,r) = 1 for all r. Thus, 
the value of F along the line r = s is 1 for any assignment 
of probabilities. 

Now suppose that for a particular pair, r Q ,s o , 
F(r Q ,s o ) = 0. Looking at our coordinate system, all points 
to the northwest of (r ,s ) have value 0 under the function 
F. By the same reasoning if F(r,s) > 0, then all points 
to the southeast of (r,s) have values greater than 0 under 
the function F. We also know that since 
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F(r oJ S Q ) = F(r o ,S Q -6) F(s o -S,s o ) = 0, then either 

F(r Q jS q - 6 ) = 0, or F(s q -6,s o ) = 0. 

Thus, there exists some point of value 0 under F along the 

two lines which form the boundary of all the points to the 

southeast of (r ,s ). Suppose it is the point (r ,s -6). 

o o o o 

By condition (3), all points between (r Q ,s o -6) and (r ,s ) 
have value 0 under F. If we add on an additional property 
that for all £^,£2 > 0, F (r o +e^ , s q -£ 2 ) > 0, we can argue 
that for y such that 0 < y < 6, and all e > 0, 

F(r oi s o -6-e) F( s q - 6 -% s q -6+y ) = F(r o ,S o -6+y) = 0. 

Since F(s o ~6-£,s o -6+y) > 0 by hypothesis, F(r o ,s o ~6-e) = 0 

for all e > 0. Therefore with the added property, all 

points between (r ,s ) and (r ,r ) have value 0 under F. 

^ o s o o s o 

If (s q -6,s o ) is the point having value 0 under F, instead 

of (r o ,s o ~6), the same arguments would hold for the points 

between (r ,s ) and (s ,s ), 
o 3 o 0 0 

Consider the following set of points along a path. A, 
in the domain of F. From this path we form the regions 
X, Y, and Z. If we specify arbitrary positive values to 
all points on path A, and if these values are consistent 
with the three conditions of F, then we may argue that all 
points in the regions X, Y, and Z have values determined 



39 



s 

* 




by the values along the path A. For example, consider a 
point, (r,s), in the region X. We have that 

F(u2,s) = F(u2,r) F(r,s), by condition ( 2 ). 

Since we have specified the values for F(u2>s) and F(u2>r), 
F(r,s) is forced to assume a particular value. We may use 
the same argument for all points along the northern border 
of X, which is a continuation of the horizontal line in 
path A. Thus, all points between (u^,v^) and (v^,v^) have 
a specified value, and, hence, we may determine the values 
in the region Y in the same manner as we did in the region 
X. Now we have values for all points between and 

( u l, u l), and, therefore, we may determine the values in 
the region Z. From this result we conclude that it is 
sufficient to define our function F only along a path such 



ilO 



as A in order to define the function in the smallest 
southeast region containing the path. 

From this development of the function F, we conclude 
our work with a series of results. 

Lemma 1 : If F(r,s) > 0, then 

i) F(r,*) is continuous on [r,s] 
and, ii) F(*,s) is continuous on [r,s] 

Proof : For i) we know that for s e [r,s], 

lim F(r,s’-6) = F(r,s). Since F(s+6,s) > 0 for all 6 > 0, 

6+0 

and since the lim F(s+6,s) = F(iT,s) > 0 
6+0 

lim F(r,s+6) = lim (F(r ,s )/F(s+6 ,s ) ) = F(r,F). 

6+0 6+0 

Thus, i) is true, and similarly, ii) is true. 

Since F is continuous along the line r = s, by 
Lemma 1, F is continuous on all the boundary of a triangular 
region in the domain of F. Thus, 

Lemma 2 : If F(r,s) > 0, then F is continuous on 

the closed, southeastern region of the point (r,s). 

The lemma follows since the boundary values determine 



the interior values. 



Theorem : If lim F(r,s) > 0, then lim F(r,s) = F(r ,s ) 

r-*-r r-*-r 

o o 



s-*-s 



s->-s 



Proof : If lim F(r,s) > 0, then there is a neighbor- 

r+r 

o 

s+s 

o 

hood about (r ,s q ) such that F is positive in this region. 

In particular, F is positive at some point in the neighbor- 
hood which is northwest of (r o ,s Q ). Thus, by Lemma 2, F 

is continuous at the point' (r ,s ). 

^ o ’ o 



Corollary : The lim F(a-— ,a+— ) either equals 0 or 1. 



n+oo 



n n 



Proof : If for some N, F(a-^-,a+^-) > 0, then by 

Lemma 2, F is continuous at (a, a). Thus 

lim F(a-— ,a+— ) = F(a,a) = 1. If no such N exists, then 
n ->co n* n 

for all n, F(a--,a+-) = 0. Thus, lim F(a--,a+-) = 0, 

n . n n -voo n n 

and the corollary is proved. 



Corollary : The probability of the event 

{lim x = 1} is either 0 or P(x. = 1). That is to say, 
» s u 

s-*t 



the sample paths passing through 1 at time t are either 



almost all continuous or almost all discontinuous. 



Proof : 

oo 

let Q * l> Q . 

i n 



Consider the set Q = M, ,, 1 . ,1\. and 



The event Q is not the same as the event 



{x^ = 1}. But from the previous corollary, P(Q) = P(x^ = 
unless the Q^’s are null sets, in which case P(Q) = 0. 



CONCLUSION 



In the non-separable process we have reduced the 
probability of some (or all) of our ^-sets with respect to 
its separable probability. Since the probability of an 
set cannot be greater than its separable probability, 
an interesting question is which events in the non-separable 
process have their probabilities increased when the 
probability of an 7 ^- set is decreased. We do know that 
such events belong to the class of sets in which an 
"infinite number of transitions" have taken place over an 
interval. However, such events have separable probability 
0. Since the factor function P - approach seemed to answer 
many vague ideas about non-separability, perhaps with a 
fuller characterization of F, such questions as that 
mentioned above may be answered. 
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